Exploring the Mobile Phone as a Platform for a Portable, Non-Invasive, and Robust Sign Language Recognition System
نویسنده
چکیده
This thesis explores the possibility of creating a portable, non-invasive, and robust sign language recognition system on a mobile device, capable of improving the quality of life of sign language users. A gesture recognition app was implemented for iOS in Objective-C and C++, using the OpenCV library for computer vision. This app was compared to the Thalmic Labs Myo, which has been successfully used as a sign language recognition platform. Under laboratory conditions, the mobile phone app reached a 96.83% overall classification rate, while the Myo reached a 94.44% classification rate. Despite this accuracy rate for the app, there are severe limitations that make the mobile platform unviable in its current state. However, its promising best-case results suggest that if those limitations can be resolved, then the mobile platform could be as effective as the Myo, and therefore an effective SLR tool.
منابع مشابه
MAN-MACHINE INTERACTION SYSTEM FOR SUBJECT INDEPENDENT SIGN LANGUAGE RECOGNITION USING FUZZY HIDDEN MARKOV MODEL
Sign language recognition has spawned more and more interest in human–computer interaction society. The major challenge that SLR recognition faces now is developing methods that will scale well with increasing vocabulary size with a limited set of training data for the signer independent application. The automatic SLR based on hidden Markov models (HMMs) is very sensitive to gesture's shape inf...
متن کاملAn Information-Theoretic Discussion of Convolutional Bottleneck Features for Robust Speech Recognition
Convolutional Neural Networks (CNNs) have been shown their performance in speech recognition systems for extracting features, and also acoustic modeling. In addition, CNNs have been used for robust speech recognition and competitive results have been reported. Convolutive Bottleneck Network (CBN) is a kind of CNNs which has a bottleneck layer among its fully connected layers. The bottleneck fea...
متن کاملRobust Sliding Mode Controller for Trajectory Tracking and Attitude Control of a Nonholonomic Spherical Mobile Robot
Based on dynamic modeling, robust trajectory tracking control of attitude and position of a spherical mobile robot is proposed. In this paper, the spherical robot is composed of a spherical shell and three independent rotors which act as the inner driver mechanism. Owing to rolling without slipping assumption, the robot is subjected to two nonholonomic constraints. The state space representatio...
متن کاملExploring the Potential of a Mobile Messaging Application for Self-Initiated Language Learning
With the rapid expansion of deploying mobile instant messaging applications such as Telegram for the purpose of language learning, it is quite apparent that language research in this regard is lagging behind the trend. This study addressed the matter by exploring how language learners utilize a Telegram group for the purpose of language learning. In this regard, the activities of a Telegram lan...
متن کاملAn Investigation Into the Impact of Shortened Texting on Muslim Learners’ Correspondence Ability
High penetrability of wireless, mobile, portable, and handheld devices has resultedin education for all as the mobile’s challenge coincides with an unprecedentedgrowth in access to pedagogical materials technology, particularly in developingcountries (UNESCO Mobile Learning Week Report, 2011). The present study setout to discover how Muslim learners of English as a foreign language (EFL) areenc...
متن کامل